Method for controlling audio output by application through earphones and electronic device implementing same

ABSTRACT

Various embodiments provide an electronic device and a method, the device comprising: an audio module; a display; a connection terminal connected to earphones; a communication interface; and a processor electrically connected to the audio module, the display, the connection terminal, or the communication interface, wherein the processor is set to display execution screens associated with a first application and a second application through a multi-window, respectively, and output an audio signal corresponding to the first application and an audio signal corresponding to the second application to a left terminal or a right terminal of the earphones separately based on a window position corresponding to each execution screen. In addition, other embodiments are also possible.

CLAIM OF PRIORITY

This application is a National Phase Entry of PCT InternationalApplication No. PCT/KR2018/010464, which was filed on Sep. 7, 2018 andclaims a priority to Korean Patent Application No. 10-2017-0114967,which was filed on Sep. 8, 2017, the contents of which are incorporatedherein by reference.

TECHNICAL FIELD

Various embodiments relate to a method and device for controlling audiooutput for each application through earphones.

BACKGROUND ART

With the recent growth of digital technologies, various types ofelectronic devices are being widely used such as mobile communicationterminals, personal digital assistants (PDAs), electronic organizers,smart phones, tablet personal computers (PCs), wearable devices, etc.These electronic devices are being continuously improved in hardwareaspects and/or software aspects, for the sake of function support andenhancement.

For example, the electronic device is providing a multi-window function.The multi-window function can divide one display region into two ones(e.g., a first display region and a second display region), to rundifferent applications in the respective display regions. That is, auser can play a video in the first display region of the electronicdevice, and execute a memo or e-mail in the second display region of theelectronic device, to view the video while checking the memo or e-mail.

DISCLOSURE OF INVENTION Technical Problem

When applications executed in a multi-window all output audio signals,the conventional electronic device outputs only one audio signal, anddoes not output the other audio signals. For example, the electronicdevice can divide one display region into a first display region and asecond display region, and play a video in the first display region andplay a TV program in the second display region. In this case, theelectronic device outputs only an audio signal corresponding to thevideo, and does not output an audio signal of the TV program. That is,the electronic device controls to mute process the audio signal of theTV program, in order not to output the same through a speaker. Or, theelectronic device can overlay two audio signals and output as well.

Various embodiments may provide a method and device capable ofoutputting audio signals corresponding to applications displayedrespectively in at least two divided multi-windows, to a left terminalof earphones and a right terminal thereof, respectively.

Solution to Problem

An electronic device of various embodiments may include an audio module,a display, a connection terminal connected to earphones, a communicationinterface, and a processor electrically connected to the audio module,the display, the connection terminal, or the communication interface.The processor may be configured to display execution screens associatedwith a first application and a second application through amulti-window, respectively, and output an audio signal corresponding tothe first application and an audio signal corresponding to the secondapplication, to a left terminal of the earphones or a right terminalthereof, separately based on a window position corresponding to eachexecution screen.

An electronic device of various embodiments may include an audio module,a display, a connection terminal connected to earphones, a communicationinterface, and a processor electrically connected to the audio module,the display, the connection terminal, or the communication interface.The processor may be configured to display an execution screen of afirst application, construct a multi-window in response to a phone eventbeing obtained, display execution screens of the first application andan application associated with a phone through a multi-window, set anaudio output path based on a window position corresponding to eachexecution screen, and output audio signals corresponding to the firstapplication and the application associated with the phone, via the setaudio output path, respectively.

An operation method of an electronic device of various embodiments mayinclude displaying execution screens associated with a first applicationand a second application through a multi-window, respectively, andoutputting an audio signal corresponding to the first application and anaudio signal corresponding to the second application, to a left terminalof the earphones or a right terminal thereof, separately based on awindow position corresponding to each execution screen.

Advantageous Effects of Invention

According to various embodiments, by outputting audio signalscorresponding to a plurality of applications separately to a leftterminal of earphones and a right terminal thereof respectively, theconcurrently outputted two audio signals may be provided withoutoverlay.

According to various embodiments, by providing not to overlay twomutually different audio signals concurrently outputted from at leasttwo or more mutually different applications, a user convenience may beimproved.

According to various embodiments, at least two or more users may use oneelectronic device concurrently.

BRIEF DESCRIPTION OF DRAWINGS

FIG. 1 is a block diagram of an electronic device within a networkenvironment according to various embodiments.

FIG. 2 is a block diagram of an audio module 170 according to variousembodiments.

FIG. 3 is a block diagram 300 of a display device 160 according tovarious embodiments.

FIG. 4 is a diagram illustrating an example of a processor of anelectronic device according to various embodiments.

FIG. 5A and FIG. 5B are diagrams illustrating an example of controllingaudio output for each application according to various embodiments.

FIG. 6 is a flowchart illustrating an operation method of an electronicdevice according to various embodiments.

FIG. 7 is a diagram illustrating an example of outputting an audio foreach application to a plurality of earphones according to variousembodiments.

FIG. 8 is a diagram illustrating an example of controlling an audiovolume for each application according to various embodiments.

FIG. 9 is a flowchart illustrating a method for changing an audio outputpath based on a window position in an electronic device according tovarious embodiments.

FIG. 10 is a diagram illustrating an example of changing an audio outputpath in accordance with a window position change according to variousembodiments.

FIG. 11 is a flowchart illustrating a method of controlling audio outputin accordance with a phone event in an electronic device according tovarious embodiments.

FIG. 12 is a diagram illustrating an example of controlling audio outputin accordance with a phone event according to various embodiments.

FIG. 13 is a flowchart illustrating a method of controlling audio outputin accordance with a video call event in an electronic device accordingto various embodiments.

FIG. 14 is a diagram illustrating an example of constructing amulti-window based on a video call application in an electronic deviceaccording to various embodiments.

FIG. 15 is a diagram illustrating an example of controlling a userinterface associated with a video call application in accordance with awindow position change in an electronic device according to variousembodiments.

BEST MODE FOR CARRYING OUT THE INVENTION

Various embodiments of the present document are mentioned below withreference to the accompanying drawings. An embodiment and terms usedtherein do not intend to limit the technologies mentioned in the presentdocument to a specific embodiment form, and should be understood toinclude various modifications, equivalents, and/or alternatives of acorresponding embodiment. With regard to a description of the drawings,like reference numerals may be used to refer like components. And, anembodiment disclosed in the present disclosure has been suggested forexplanation and understanding of the technology content disclosed, anddoes not limit the scope of the technology mentioned in the presentdisclosure. Accordingly, the scope of the present disclosure should beinterpreted as including all changes or various other embodiments thatare based on the technological spirit of the present disclosure.

FIG. 1 is a block diagram illustrating an electronic device 101 in anetwork environment 100 according to various embodiments.

Referring to FIG. 1, the electronic device 101 in the networkenvironment 100 may communicate with an electronic device 102 via afirst network 198 (e.g., a short-range wireless communication network),or an electronic device 104 or a server 108 via a second network 199(e.g., a long-range wireless communication network). According to anembodiment, the electronic device 101 may communicate with theelectronic device 104 via the server 108. According to an embodiment,the electronic device 101 may include a processor 120, memory 130, aninput device 150, a sound output device 155, a display device 160, anaudio module 170, a sensor module 176, an interface 177, a haptic module179, a camera module 180, a power management module 188, a battery 189,a communication module 190, a subscriber identification module (SIM)196, or an antenna module 197. In some embodiments, at least one (e.g.,the display device 160 or the camera module 180) of the components maybe omitted from the electronic device 101, or one or more othercomponents may be added in the electronic device 101. In someembodiments, some of the components may be implemented as singleintegrated circuitry. For example, the sensor module 176 (e.g., afingerprint sensor, an iris sensor, or an illuminance sensor) may beimplemented as embedded in the display device 160 (e.g., a display).

The processor 120 may execute, for example, software (e.g., a program140) to control at least one other component (e.g., a hardware orsoftware component) of the electronic device 101 coupled with theprocessor 120, and may perform various data processing or computation.According to one embodiment, as at least part of the data processing orcomputation, the processor 120 may load a command or data received fromanother component (e.g., the sensor module 176 or the communicationmodule 190) in volatile memory 132, process the command or the datastored in the volatile memory 132, and store resulting data innon-volatile memory 134. According to an embodiment, the processor 120may include a main processor 121 (e.g., a central processing unit (CPU)or an application processor (AP)), and an auxiliary processor 123 (e.g.,a graphics processing unit (GPU), an image signal processor (ISP), asensor hub processor, or a communication processor (CP)) that isoperable independently from, or in conjunction with, the main processor121. Additionally or alternatively, the auxiliary processor 123 may beadapted to consume less power than the main processor 121, or to bespecific to a specified function. The auxiliary processor 123 may beimplemented as separate from, or as part of the main processor 121.

The auxiliary processor 123 may control at least some of functions orstates related to at least one component (e.g., the display device 160,the sensor module 176, or the communication module 190) among thecomponents of the electronic device 101, instead of the main processor121 while the main processor 121 is in an inactive (e.g., sleep) state,or together with the main processor 121 while the main processor 121 isin an active state (e.g., executing an application). According to anembodiment, the auxiliary processor 123 (e.g., an image signal processoror a communication processor) may be implemented as part of anothercomponent (e.g., the camera module 180 or the communication module 190)functionally related to the auxiliary processor 123.

The memory 130 may store various data used by at least one component(e.g., the processor 120 or the sensor module 176) of the electronicdevice 101. The various data may include, for example, software (e.g.,the program 140) and input data or output data for a command relatedthereto. The memory 130 may include the volatile memory 132 or thenon-volatile memory 134.

The program 140 may be stored in the memory 130 as software, and mayinclude, for example, an operating system (OS) 142, middleware 144, oran application 146.

The input device 150 may receive a command or data to be used by othercomponent (e.g., the processor 120) of the electronic device 101, fromthe outside (e.g., a user) of the electronic device 101. The inputdevice 150 may include, for example, a microphone, a mouse, or akeyboard.

The sound output device 155 may output sound signals to the outside ofthe electronic device 101. The sound output device 155 may include, forexample, a speaker or a receiver. The speaker may be used for generalpurposes, such as playing multimedia or playing record, and the receivermay be used for an incoming calls. According to an embodiment, thereceiver may be implemented as separate from, or as part of the speaker.

The display device 160 may visually provide information to the outside(e.g., a user) of the electronic device 101. The display device 160 mayinclude, for example, a display, a hologram device, or a projector andcontrol circuitry to control a corresponding one of the display,hologram device, and projector. According to an embodiment, the displaydevice 160 may include touch circuitry adapted to detect a touch, orsensor circuitry (e.g., a pressure sensor) adapted to measure theintensity of force incurred by the touch.

The audio module 170 may convert a sound into an electrical signal andvice versa. According to an embodiment, the audio module 170 may obtainthe sound via the input device 150, or output the sound via the soundoutput device 155 or a headphone of an external electronic device (e.g.,an electronic device 102) directly (e.g., wired) or wirelessly coupledwith the electronic device 101.

The sensor module 176 may detect an operational state (e.g., power ortemperature) of the electronic device 101 or an environmental state(e.g., a state of a user) external to the electronic device 101, andthen generate an electrical signal or data value corresponding to thedetected state. According to an embodiment, the sensor module 176 mayinclude, for example, a gesture sensor, a gyro sensor, an atmosphericpressure sensor, a magnetic sensor, an acceleration sensor, a gripsensor, a proximity sensor, a color sensor, an infrared (IR) sensor, abiometric sensor, a temperature sensor, a humidity sensor, or anilluminance sensor.

The interface 177 may support one or more specified protocols to be usedfor the electronic device 101 to be coupled with the external electronicdevice (e.g., the electronic device 102) directly (e.g., wired) orwirelessly. According to an embodiment, the interface 177 may include,for example, a high definition multimedia interface (HDMI), a universalserial bus (USB) interface, a secure digital (SD) card interface, or anaudio interface.

A connecting terminal 178 may include a connector via which theelectronic device 101 may be physically connected with the externalelectronic device (e.g., the electronic device 102). According to anembodiment, the connecting terminal 178 may include, for example, a HDMIconnector, a USB connector, a SD card connector, or an audio connector(e.g., a headphone connector),

The haptic module 179 may convert an electrical signal into a mechanicalstimulus (e.g., a vibration or a movement) or electrical stimulus whichmay be recognized by a user via his tactile sensation or kinestheticsensation. According to an embodiment, the haptic module 179 mayinclude, for example, a motor, a piezoelectric element, or an electricstimulator.

The camera module 180 may capture a still image or moving images.According to an embodiment, the camera module 180 may include one ormore lenses, image sensors, image signal processors, or flashes.

The power management module 188 may manage power supplied to theelectronic device 101. According to one embodiment, the power managementmodule 188 may be implemented as at least part of, for example, a powermanagement integrated circuit (PMIC).

The battery 189 may supply power to at least one component of theelectronic device 101. According to an embodiment, the battery 189 mayinclude, for example, a primary cell which is not rechargeable, asecondary cell which is rechargeable, or a fuel cell.

The communication module 190 may support establishing a direct (e.g.,wired) communication channel or a wireless communication channel betweenthe electronic device 101 and the external electronic device (e.g., theelectronic device 102, the electronic device 104, or the server 108) andperforming communication via the established communication channel. Thecommunication module 190 may include one or more communicationprocessors that are operable independently from the processor 120 (e.g.,the application processor (AP)) and supports a direct (e.g., wired)communication or a wireless communication. According to an embodiment,the communication module 190 may include a wireless communication module192 (e.g., a cellular communication module, a short-range wirelesscommunication module, or a global navigation satellite system (GNSS)communication module) or a wired communication module 194 (e.g., a localarea network (LAN) communication module or a power line communication(PLC) module). A corresponding one of these communication modules maycommunicate with the external electronic device via the first network198 (e.g., a short-range communication network, such as BLUETOOTH,wireless-fidelity (Wi-Fi) direct, or infrared data association (IrDA))or the second network 199 (e.g., a long-range communication network,such as a cellular network, the Internet, or a computer network (e.g.,LAN or wide area network (WAN)). These various types of communicationmodules may be implemented as a single component (e.g., a single chip),or may be implemented as multi components (e.g., multi chips) separatefrom each other.

According to an embodiment, the wireless communication module 192 mayidentify and authenticate the electronic device 101 in a communicationnetwork using subscriber information (e.g., international mobilesubscriber identity (IMSI)) stored in the subscriber identificationmodule 196.

The antenna module 197 may transmit or receive a signal or power to orfrom the outside (e.g., the external electronic device) of theelectronic device 101. According to an embodiment, the antenna module197 may include one or more antennas, and, therefrom, at least oneantenna appropriate for a communication scheme used in the communicationnetwork, such as the first network 198 or the second network 199, may beselected, for example, by the communication module 190 (e.g., thewireless communication module 192). The signal or the power may then betransmitted or received between the communication module 190 and theexternal electronic device via the selected at least one antenna.

At least some of the above-described components may be coupled mutuallyand communicate signals (e.g., commands or data) therebetween via aninter-peripheral communication scheme (e.g., a bus, general purposeinput and output (GPIO), serial peripheral interface (SPI), or mobileindustry processor interface (MIPI)).

According to an embodiment, commands or data may be transmitted orreceived between the electronic device 101 and the external electronicdevice 104 via the server 108 coupled with the second network 199. Eachof the electronic devices 102 and 104 may be a device of a same type as,or a different type, from the electronic device 101.

According to an embodiment, all or some of operations to be executed atthe electronic device 101 may be executed at one or more of the externalelectronic devices 102, 104. For example, if the electronic device 101should perform a function or a service automatically, or in response toa request from a user or another device, the electronic device 101,instead of, or in addition to, executing the function or the service,may request the one or more external electronic devices to perform atleast part of the function or the service. The one or more externalelectronic devices receiving the request may perform the at least partof the function or the service requested, or an additional function oran additional service related to the request, and transfer an outcome ofthe performing to the electronic device 101. The electronic device 101may provide the outcome, with or without further processing of theoutcome, as at least part of a reply to the request. To that end, acloud computing, distributed computing, or client-server computingtechnology may be used, for example.

FIG. 2 is a block diagram of the audio module 170 according to variousembodiments.

Referring to FIG. 2, the audio module 170 may include, for example, anaudio input interface 210, an audio input mixer 220, an analog todigital converter (ADC) 230, an audio signal processor 240, a digital toanalog converter (DAC) 250, an audio output mixer 260, or an audiooutput interface 270.

The audio input interface 210 may receive an audio signal correspondingto sound obtained from the outside of the electronic device 101 via amicrophone (e.g., a dynamic microphone, a condenser microphone, or apiezo microphone) which is configured as part of the input device 150 orseparately from the electronic device 101. For example, in response toobtaining an audio signal from the external electronic device 102 (e.g.,a headset or microphone), the audio input interface 210 may be connectedwith the external electronic device 102 wiredly via the connectionterminal 178 or wirelessly (e.g., Bluetooth communication) via thewireless communication module 192, to receive the audio signal.According to an embodiment, the audio input interface 210 may receive acontrol signal (e.g., a volume adjustment signal using an input button)related to the audio signal obtained from the external electronic device102. The audio input interface 210 may include a plurality of audioinput channels, and receive a different audio signal by each audio inputchannel. According to an embodiment, additionally or alternatively, theaudio input interface 210 may receive an audio signal from anothercomponent (e.g., the processor 120 or the memory 130) of the electronicdevice 101.

The audio input mixer 220 may synthesize a plurality of inputted audiosignals into at least one audio signal. According to an embodiment, theaudio input mixer 220 may synthesize a plurality of analog audio signalsinputted via the audio input interface 210, into at least one analogaudio signal.

The ADC 230 may convert an analog audio signal into a digital audiosignal. According to an embodiment, the ADC 230 may convert an analogaudio signal received via the audio input interface 210 or, additionallyor alternatively, an analog audio signal synthesized via the audio inputmixer 220 into a digital audio signal.

The audio signal processor 240 may perform various processing on adigital audio signal received via the ADC 230 or a digital audio signalreceived from another component of the electronic device 101. Forexample, the audio signal processor 240 may perform sampling rate changefor one or more digital audio signals, applying of one or more filters,interpolation processing, amplification or attenuation (e.g., partialfrequency band or whole frequency band amplification or attenuation)processing, noise processing (e.g., noise or echo attenuation), channelchange (e.g., switching between mono and stereo), mixing, or specifiedsignal obtaining. According to an embodiment, at least some functions ofthe audio signal processor 240 may be implemented in the form of anequalizer.

The DAC 250 may convert a digital audio signal into an analog audiosignal. According to an embodiment, the DAC 250 may convert a digitalaudio signal processed by the audio signal processor 240 or a digitalaudio signal acquired from another component of the electronic device101, into an analog audio signal.

The audio output mixer 260 may synthesize a plurality of audio signalsto be outputted, into at least one audio signal. According to anembodiment, the audio output mixer 260 may synthesize an analog audiosignal converted by the DAC 250 and another analog audio signal (e.g.,an analog audio signal received via the audio input interface 210), intoat least one analog audio signal.

The audio output interface 270 may output an analog audio signalconverted by the DAC 250 or, additionally or alternatively, an analogaudio signal synthesized by the audio output mixer 260, to the outsideof the electronic device 101 via the sound output device 155 (e.g., aspeaker (e.g., a dynamic driver or balanced armature driver) or areceiver). According to an embodiment, the sound output device 155 mayinclude a plurality of speakers, and the audio output interface 270 mayoutput an audio signal having a plurality of mutually different channels(e.g., stereo or 5.1 channel) via at least some speakers among theplurality of speakers. According to an embodiment, the audio outputinterface 270 may be connected with the external electronic device 102(e.g., an external speaker or a headset) wiredly via the connectionterminal 178 or wirelessly via the wireless communication module 192, tooutput an audio signal.

According to an embodiment, the audio module 170 may synthesize aplurality of digital audio signals to provide at least one digital audiosignal as at least a partial function of the audio signal processor 240,without separately including the audio input mixer 220 or the audiooutput mixer 260.

According to an embodiment, the audio module 170 may include an audioamplifier (not shown) (e.g., a speaker amplifying circuit) capable ofamplifying an analog audio signal that is inputted via the audio inputinterface 210 or an audio signal that will be outputted via the audiooutput interface 270. According to an embodiment, the audio amplifiermay be constructed as a module separate from the audio module 170.

FIG. 3 is a block diagram 300 of the display device 160 according tovarious embodiments.

Referring to FIG. 3, the display device 160 may include a display 310,and a display driver IC (DDI) 330 to control the display 310. The DDI330 may include an interface module 331, a memory 333 (e.g., buffermemory), an image processing module 335, or a mapping module 337. TheDDI 330 may, for example, receive video information which includes videodata or a video control signal corresponding to a command forcontrolling the video data, from the processor 120 (e.g., the mainprocessor 121 (e.g., an application processor) or the auxiliaryprocessor 123 operating independently from a function of the mainprocessor 121) through the interface module 331. The DDI 330 maycommunicate with a touch circuitry 350 or a sensor module 376, etc. viathe interface module 331. Also, the DDI 330 may also store at least partof the received video information in the memory 333, for example, on aframe by frame basis.

The image processing module 335 may, for example, perform pre-processingor post-processing (e.g., resolution, brightness, or size adjustment)for at least part of the video data, based at least on a characteristicof the video data or a characteristic of the display 310. The mappingmodule 337 may convert the video data pre-processed or post-processedthrough the image processing module 135 into a voltage value or currentvalue capable of driving pixels of the display 310, based at least onattributes (e.g., an array (RGB stripe or PenTile) of the pixels, or asize of each of sub pixels) of the pixels of the display 310. At leastsome pixels of the display 310 may be driven, for example, based atleast on the voltage value or the current value wherein visualinformation (e.g., a text, an image or an icon) corresponding to thevideo data may be displayed on the display 310.

According to an embodiment, the display device 160 may further includethe touch circuitry 350. The touch circuitry 350 may include a touchsensor 351, and a touch sensor IC 353 to control the touch sensor 351.The touch sensor IC 353 may control the touch sensor 351, to measure,for example, a variation of a signal (e.g., a voltage, a quantity oflight, resistance, or a quantity of electric charge) on a specificposition of the display 310, thereby sensing a touch input or hoveringinput on the specific position, and providing information (e.g., aposition, an area, a pressure or time) about the sensed touch input orhovering input to the processor 120. According to an embodiment, atleast part (e.g., the touch sensor IC 353) of the touch circuitry 350may be included as part of the display driver IC 330 or the display 310or as part of another component (e.g., the auxiliary processor 123)disposed outside the display device 160.

According to an embodiment, the display device 160 may further includeat least one sensor (e.g., a fingerprint sensor, an iris sensor, apressure sensor, or an illuminance sensor) of the sensor module 376, ora control circuit for the at least one sensor. In such a case, the atleast one sensor or the control circuit for the at least one sensor maybe embedded in one portion (e.g., the display 310 or the DDI 330) of thedisplay device 160 or one portion of the touch circuitry 350. Forexample, in response to the sensor module 376 embedded in the displaydevice 160 including a biometric sensor (e.g., a fingerprint sensor),the biometric sensor may obtain biometric information (e.g., afingerprint image) associated with a touch input via a portion of thedisplay 310. For another example, in response to the sensor module 376embedded in the display device 160 including a pressure sensor, thepressure sensor may obtain pressure information on a touch input via apartial or whole region of the display 310. According to an embodiment,the touch sensor 351 or the sensor module 376 may be disposed betweenpixels in a pixel layer of the display 310, or over or under the pixellayer.

FIG. 4 is a diagram illustrating an example of a processor of anelectronic device according to various embodiments.

Referring to FIG. 4, the processor 120 of the electronic device (e.g.,the electronic device 101) may control to output audio signalscorresponding to applications displayed respectively in at least twodivided multi-windows, to a left terminal of earphones and a rightterminal thereof, respectively. For the sake of this, the processor 120may include a module related with function processing, and the modulemay be included as a hardware module, or be included as a softwaremodule. For example, the processor 120 may include a display controlmodule 410 and an application control module 420, or an audio outputcontrol module 430.

Below, a description will be made in which a multi-window consists of afirst window and a second window in order to help the understanding ofthe present disclosure. But, the multi-window may be variouslyconstructed as three or four, etc. in number, and constructing themulti-window is an issue of implementation, so the present disclosure isnot limited by the following description.

The display control module 410 may construct a display device (e.g., thedisplay device 160) of the electronic device 101 as a multi-window. Themulti-window may divide one display region into two ones (e.g., a firstdisplay region and a second display region), and execute mutuallydifferent applications in the respective display regions. For example,the display control module 410 may divide one display region of thedisplay device 160 into at least two ones, to construct themulti-window. At this time, the display control module 410 may control adisplay direction of each window based on a direction (or a displaydirection) of the electronic device 101.

For example, the display control module 410 may obtain a direction ofthe electronic device 101 by using a sensor module (e.g., the sensormodule 176 (e.g., a gyro sensor)) of the electronic device 101. Thedisplay direction is a direction in which the electronic device 101 isput, and may be, for example, a vertical direction (or a vertical mode)or a horizontal direction (or a horizontal mode). In response to thedisplay direction of the electronic device 101 being the verticaldirection, the display control module 410 may construct the multi-windowwherein each window is divided up (e.g., first window) and down (e.g.,second window). Also, in response to the display direction of theelectronic device 101 being the horizontal direction, the displaycontrol module 410 may construct the multi-window wherein each window isdivided left (e.g., first window) and right (e.g., second window).

The application control module 420 may control to display executionscreens of at least two or more applications through the constructedmulti-window. For example, in response to the multi-window beingconstructed in a vertical direction, the application control module 420may control to display an execution screen of a first application in thevertical direction in a first window arranged at an upper side, anddisplay an execution screen of a second application in the verticaldirection in a second window arranged at a lower side. Or, in responseto the multi-window being constructed in a horizontal direction, theapplication control module 420 may control to display an executionscreen of a first application in the horizontal direction in a firstwindow arranged at a left side, and display an execution screen of asecond application in the horizontal direction in a second windowarranged at a right side. At this time, the application control module420 may adjust a size of the execution screen of the first applicationor the second application based on a display direction of themulti-window. The application control module 420 may zoom in or zoom outup/down or left/right the size of the execution screen of the firstapplication or the second application.

The application control module 420 of various embodiments may constructan execution screen of an application within a window based on at leastone of a display direction of a multi-window, a display size orinformation (e.g., an attribute, a type, etc.) of the application. Forexample, the application control module 420 may differently oridentically construct an execution screen of an application displayed ina general mode of using the entire display region and an executionscreen of an application displayed in a multi-window mode of using atleast part of the display region. For example, in response to theapplication being a document application or web page application inwhich a text is displayed, the application control module 420 may adjusta size of a letter included in the application, or adjust an amount ofinformation included in the application.

Or, in response to not capable of displaying the execution screen of theapplication in the vertical direction (e.g., a game application and avideo application), the application control module 420 may display theexecution screen of the application in the horizontal direction, anddisplay, as a non-used region, an up/down partial region of a windowdisplayed in the horizontal direction as well. For example, the non-usedregion may be displayed in black. Or, in response to not capable ofdisplaying the execution screen of the application in the horizontaldirection, the application control module 420 may display the executionscreen of the application in the vertical direction, and display, as anon-used region, a left/right partial region of a window displayed inthe vertical direction as well.

The audio output control module 430 may control an audio signal for eachapplication displayed through a multi-window. For example, the audiooutput control module 430 may control the audio signal for eachapplication based on information of an application displayed through themulti-window. In response to only one of at least two applicationsdisplayed in the multi-window outputting an audio, the audio outputcontrol module 430 may not set an audio output path. Or, in response toall the at least two applications displayed in the multi-windowoutputting an audio, the audio output control module 430 may set theaudio output path. While all of the at least two applications displayedin the multi-window output an audio, and earphones (or headphones) areconnected to a connection terminal (e.g., the connection terminal 178)of the electronic device 101 (or a state in which the earphones areconnected wirelessly), the audio output control module 430 of variousembodiments may set the audio output path.

For example, in response to the multi-window being constructed in thehorizontal direction, the audio output control module 430 may set anaudio output path corresponding to a first application displayed at aleft side (e.g., first window), to a right terminal of the earphones,and set an audio output path corresponding to a second applicationdisplayed at a right side (e.g., second window), to a left terminal ofthe earphones. Or, in response to the multi-window being constructed inthe horizontal direction, the audio output control module 430 may setthe audio output path corresponding to the first application displayedat the left side (e.g., first window), to the left terminal of theearphones, and set the audio output path corresponding to the secondapplication displayed at the right side (e.g., second window), to theright terminal of the earphones.

In response to the multi-window being constructed in the verticaldirection, the audio output control module 430 may set an audio outputpath corresponding to a first application displayed at an upper side(e.g., first window), to the right terminal of the earphones, and set anaudio output path corresponding to a second application displayed at alower side (e.g., second window), to the left terminal of the earphones.Or, in response to the multi-window being constructed in the verticaldirection, the audio output control module 430 may set the audio outputpath corresponding to the first application displayed at the upper side(e.g., first window), to the left terminal of the earphones, and set theaudio output path corresponding to the second application displayed atthe lower side (e.g., second window), to the right terminal of theearphones.

The audio output control module 430 of various embodiments may processan audio signal based on information of an application. For example, theaudio output control module 430 may control to unite an audio signalcorresponding to one application into one, to output to any one terminalof earphones. In response to the earphones being connected to theelectronic device 101, the audio output control module 430 may outputmutually different audio signals to a left terminal of the earphones anda right terminal thereof according to an application. For example, in amusic application, in response to the earphones being connected to theelectronic device 101, the audio output control module 430 may output anaudio signal in a stereo scheme (e.g., two-channel output). But, becausethe audio output control module 430 has to output an audio signalcorresponding to the music application to any one terminal of theearphones, in response to the audio signal being outputted in the stereoscheme, the audio output control module 430 may unite left/right audiosignals into one, to output to any one terminal of the earphones.

For example, the audio output control module 430 may synthesize theleft/right audio signals into one by using an audio input mixer (e.g.,the audio output mixer 260). The audio output control module 430 mayadjust various values such as source levels of left/right audio signalsinputted to the audio output mixer 260, a frequency characteristic, anoutput signal level, etc., to synthesize the two audio signals into one.The audio output control module 430 may control to unite left/rightaudio signals corresponding to a first application displayed in a firstwindow into one, to output to a right terminal of earphones, and controlto unite left/right audio signals corresponding to a second applicationdisplayed in a second window into one, to output to a left terminal ofthe earphones. Or, in response to an audio signal of an applicationbeing outputted in a mono scheme (e.g., one-channel output), the audiooutput control module 430 may output the audio signal to each audiooutput path without separately processing (e.g., uniting into one) ofthe audio signal.

FIG. 5A and FIG. 5B are diagrams illustrating an example of controllingaudio output for each application according to various embodiments.

FIG. 5 is a diagram illustrating an example of controlling audio outputfor each application when two users use an electronic device.

Referring to FIG. 5A, a processor (e.g., the processor 120) of anelectronic device (e.g., the electronic device 101) may display anexecution screen of an application through a multi-window. For example,while earphones are connecting to a connection terminal (e.g., theconnection terminal 178) of the electronic device 101, the processor 120may construct a multi-window which is divided into two ones in ahorizontal direction. The processor 120 may provide a user interface ofdisplaying an execution screen of a first application in a first window510 arranged at a left side, and displaying an execution screen of asecond application in a second window 520 arranged at a right side.

Here, the first application and the second application may be mutuallydifferent, and may all output audio signals. For example, the firstapplication may play a TV program, and the second application may play avideo or music. The video or music playing may be to play a video ormusic stored in the electronic device 101 (e.g., a video playapplication and a music play application), or may be to play a video onthe Internet (e.g., a streaming scheme).

The processor 120 may set an audio output path wherein a first audiosignal corresponding to the first application is outputted to a rightterminal 560 of earphones, and a second audio signal corresponding tothe second application is outputted to a left terminal 550 of theearphones. For example, the audio output path outputted to the rightterminal 560 of the earphones may be a first audio output path, and theaudio output path outputted to the left terminal 550 of the earphonesmay be a second audio output path.

For example, in response to a first user 530 and a second user 540 usingthe electronic device 101, the first user 530 may view a first window510, and the second user 540 may view a second window 520. In this case,the first user 530 may be positioned at a left side of the electronicdevice 101, and the second user 540 may be positioned at a right side ofthe electronic device 101 centering on the electronic device 101.Further, in response to the first user 530 and the second user 540 usingone earphone, the processor 120 may set an output terminal of theearphones in consideration of a user position.

The earphones are made considering a user's ear shape and thus, the leftterminal and the right terminal may be different in shape. Accordingly,the first user 530 positioned at the left side may put the earphone(e.g., the right terminal 560 of the earphones) into his/her own rightear. Also, the second user 540 positioned at the right side may put theearphone (e.g., the left terminal 550 of the earphones) into his/her ownleft ear. The processor 120 may set the first audio output pathcorresponding to the first window 510, to the right terminal 560 of theearphones, and set the second audio output path corresponding to thesecond window 520, to the left terminal 550 of the earphones.

FIG. 5B is a diagram illustrating an example of controlling audio outputfor each application when one user uses an electronic device.

Referring to FIG. 5B, while the earphones are connecting to a connectionterminal (e.g., the connection terminal 178) of the electronic device101, a processor (e.g., the processor 120) of an electronic device(e.g., the electronic device 101) may construct a multi-window which isdivided into two ones in a horizontal direction. The processor 120 mayprovide a user interface of displaying an execution screen of the firstapplication in the first window 510 arranged at the left side, anddisplaying an execution screen of the second application in the secondwindow 520 arranged at the right side. Here, the first application andthe second application may be mutually different, and may all outputaudio signals.

The processor 120 may set an audio output path wherein the first audiosignal corresponding to the first application is outputted to the leftterminal 550 of the earphones, and the second audio signal correspondingto the second application is outputted to the right terminal 560 of theearphones. For example, the first user 530 may construct the electronicdevice 101 as a multi-window, to view all of the first window 510 andthe second window 520. In this case, the processor 120 may output audiooutput corresponding to the first window 510 arranged at the left sideof the electronic device 101, to the left terminal 550 of the earphonescentering on the first user 530, and output audio output correspondingto the second window 520 arranged at the right side of the electronicdevice 101, to the right terminal 560 of the earphones.

In FIG. 5, only wired earphones are illustrated, but the earphones maybe wired earphones and wireless earphones.

An electronic device (e.g., the electronic device 101) of variousembodiments may include an audio module (e.g., the audio module 170), adisplay (e.g., the display device 160), a connection terminal (e.g., theconnection terminal 178) connected to earphones, a communicationinterface (e.g., the communication module 190), and a processor (e.g.,the processor 120) electrically connected to the audio module, thedisplay, the connection terminal, or the communication interface. Theprocessor 120 may be configured to display execution screens associatedwith a first application and a second application through amulti-window, respectively, and output an audio signal corresponding tothe first application and an audio signal corresponding to the secondapplication, to a left terminal of the earphones or a right terminalthereof, separately based on a window position corresponding to eachexecution screen.

The processor 120 may be configured to identify the window positioncorresponding to the execution screen, and identify an audio output pathbased on the identified window position, and output the audio signalcorresponding to each application via the identified audio output path.

The processor 120 may be configured to output the audio signalcorresponding to the first application displayed in a first window, tothe right terminal of the earphones, and output the audio signalcorresponding to the second application displayed in a second window, tothe left terminal of the earphones.

The first window may be configured to be arranged at a left side of ahorizontal direction, or be arranged at an upper side of a verticaldirection, and the second window ma be configured to be arranged at aright side of the horizontal direction, or be arranged at a lower sideof the vertical direction.

The processor 120 may be configured to set an audio output pathcorresponding to each window in consideration of at least one of adisplay direction of the electronic device, the number of multi-windowor the number of the earphones.

The processor 120 may be configured to, in response to a preset userinput being obtained, display a menu for controlling a volume of thefirst application or the second application.

The processor 120 may be configured to adjust a volume level of thefirst application and a volume level of the second applicationdifferently based on the obtained user input.

The processor 120 may be configured to sense window position switching,to change a window displaying the execution screen of each application,and change an audio output path based on a switched window position.

An electronic device (e.g., the electronic device 101) of variousembodiments may include an audio module (e.g., the audio module 170), adisplay (e.g., the display device 160), a connection terminal (e.g., theconnection terminal 178) connected to earphones, a communicationinterface (e.g., the communication module 190), and a processor (e.g.,the processor 120) electrically connected to the audio module, thedisplay, the connection terminal, or the communication interface. Theprocessor 120 may be configured to display an execution screen of afirst application, construct a multi-window in response to a phone eventbeing obtained, display execution screens of the first application andan application associated with a phone through a multi-window, set anaudio output path based on a window position corresponding to eachexecution screen, and output audio signals corresponding to the firstapplication and the application associated with the phone, via the setaudio output path, respectively.

The processor 120 may be configured to construct the multi-window in avertical direction or a horizontal direction based on a displaydirection of the electronic device.

The processor 120 may be configured to construct an execution screen ofan application within each window based on at least one of a displaydirection of the multi window, a display size of the multi-window orinformation of the application.

The processor 120 may be configured to set a window that will displaythe execution screen of the application associated with the phone, basedon information of the application or setting information of theelectronic device.

The processor 120 may be configured to, in response to a video callevent being obtained while the execution screen of the first applicationis displayed, identify a video call display scheme, and construct themulti-window based on the video call display scheme

The processor 120 may be configured to, in response to the video calldisplay scheme being an overlay scheme, overlay and display theexecution screen of the first application in a partial region of a callimage included in an application associated with a video call.

The processor 120 may be configured to, in response to obtaining a userinput for window position switching, overlay and display the executionscreen of the first application in another partial region of the callimage, and display the partial region of the call image.

The processor 120 may be configured to, in response to the video calldisplay scheme being a resizing scheme, adjust an execution screen of anapplication associated with a video call, to display the sameconcurrently with the execution screen of the first application.

The processor 120 may be configured to construct any one of theexecution screen of the first application or the execution screen of theapplication associated with the phone, in the form of a pop-up window,according to setting of the electronic device or a user's selection.

FIG. 6 is a flowchart illustrating an operation method of an electronicdevice according to various embodiments.

Referring to FIG. 6, in operation 601, a processor (e.g., the processor120) of an electronic device (e.g., the electronic device 101) maydisplay execution screens associated with a first application and asecond application through a multi-window. For example, while earphonesare connecting to a connection terminal (e.g., the connection terminal178) of the electronic device 101, the processor 120 may construct amulti-window which is divided into two ones in a horizontal direction.The processor 120 may provide a user interface of displaying anexecution screen of the first application in a first window arranged ata left side, and displaying an execution screen of the secondapplication in a second window arranged at a right side. Or, while theearphones are connecting to the connection terminal (e.g., theconnection terminal 178) of the electronic device 101, the processor 120may construct a multi-window which is divided into two ones in avertical direction. The processor 120 may provide a user interface ofdisplaying the execution screen of the first application in a firstwindow arranged at an upper side, and displaying the execution screen ofthe second application in a second window arranged at a lower side.Here, the first application and the second application may be mutuallydifferent applications, and may all output audio signals.

In operation 603, the processor 120 of the electronic device 101 mayidentify a window position corresponding to the execution screen. Theprocessor 120 may identify a display direction of the electronic device101, and identify the window position in the identified displaydirection. For example, the processor 120 may identify that theexecution screen of the first application is displayed in a left windowof the horizontal direction, and the execution screen of the secondapplication is displayed in a right window of the horizontal direction.Or, the processor 120 may identify that the execution screen of thefirst application is displayed in an upper window of the verticaldirection, and the execution screen of the second application isdisplayed in a lower window of the vertical direction.

In operation 605, the processor 120 of the electronic device 101 may setan audio output path based on the window position. The processor 120 mayset a first audio output path correspondingly to the first window, andset a second audio output path correspondingly to the second window. Forexample, in response to the execution screen of the first applicationbeing displayed in the left window (e.g., the first window) of thehorizontal direction, the processor 120 may set the first audio outputpath correspondingly to the first window wherein an audio signal (e.g.,a first audio signal) corresponding to the first application isoutputted to a right terminal of earphones. Also, in response to theexecution screen of the second application being displayed in the rightwindow (e.g., the second window) of the horizontal direction, theprocessor 120 may set the second audio output path correspondingly tothe second window wherein an audio signal (e.g., a second audio signal)corresponding to the second application is outputted to a left terminalof the earphones. Or, in response to the execution screen of the firstapplication being displayed in the upper window (e.g., the first window)of the vertical direction, the processor 120 may set the first audiooutput path correspondingly to the first window. In response to theexecution screen of the second application being displayed in the lowerwindow (e.g., the second window) of the vertical direction, theprocessor 120 may set the second audio output path correspondingly tothe second window.

In operation 607, the processor 120 of the electronic device 101 mayoutput an audio corresponding to each application via the set audiooutput path. For example, the processor 120 may control to output thefirst audio signal corresponding to the first application displayed inthe first window, to the right terminal of the earphones through thefirst audio output path. The processor 120 may control to output thesecond audio signal corresponding to the second application displayed inthe second window, to the left terminal of the earphones through thesecond audio output path. Also, the processor 120 may control to outputto the contrary.

FIG. 7 is a diagram illustrating an example of outputting an audio foreach application to a plurality of earphones according to variousembodiments.

Referring to FIG. 7, while earphones (e.g., first earphones 750, secondearphones 760 and third earphones 770) are connecting to a connectionterminal (e.g., the connection terminal 178) of the electronic device101, a processor (e.g., the processor 120) of an electronic device(e.g., the electronic device 101) may construct a multi-window which isdivided into two ones in a horizontal direction. The processor 120 mayprovide a user interface of displaying an execution screen of a firstapplication in a first window 710 arranged at a left side, anddisplaying an execution screen of a second application in a secondwindow 720 arranged at a right side. Here, the first application and thesecond application may be mutually different, and may all output audiosignals.

The processor 120 of various embodiments may set an audio output pathcorresponding to each window in consideration of at least one ofmulti-window information (e.g., the number of windows), earphoneinformation (e.g., the number of earphones) and a user position. Forexample, while the multi-window is constructed, the processor 120 mayidentify the number of windows and the number of connected earphones. Inresponse to the window being constructed as two, and the number ofearphones being one (e.g., the first earphones 750), the processor 120may set an audio output path wherein an audio signal corresponding tothe first application displayed in the first window 710 is outputted toa right terminal of the first earphones 750, and set an audio outputpath wherein an audio signal corresponding to the second applicationdisplayed in the second window 720 is outputted to a left terminal ofthe first earphones 750. That is, in response to two users sharing oneearphone, the processor 120 may set an output terminal of earphonescorresponding to each window in consideration of a user position.

In response to the window being constructed as two, and the number ofearphones being two (e.g., the first earphones 750 and the secondearphones 760), the processor 120 may set an audio output path whereinthe audio signal corresponding to the first application displayed in thefirst window 710 is outputted to the first earphones 750, and set anaudio output path wherein the audio signal corresponding to the firstapplication displayed in the second window 720 is outputted to thesecond earphones 760.

In response to the window being constructed as two, and the number ofearphones being three (e.g., the first earphones 750, the secondearphones 760 and the third earphones 770), the processor 120 may set anaudio output path wherein an audio signal corresponding to the firstapplication displayed in the first window 710 is outputted to the firstearphones 750 and the second earphones 760, and set an audio output pathwherein an audio signal corresponding to the second applicationdisplayed in the second window 720 is outputted to the third earphones770. Or, the processor 120 may set an audio output path wherein theaudio signal corresponding to the first application displayed in thefirst window 710 is outputted to the first earphones 750, and set anaudio output path wherein the audio signal corresponding to the secondapplication displayed in the second window 720 is outputted to thesecond earphones 760 and the third earphones 770.

Though not illustrated, in response to the window being constructed asthree, and the number of earphones being three (e.g., the firstearphones 750, the second earphones 760 and the third earphones 770),the processor 120 may set an audio output path wherein an audio signalcorresponding to the first application displayed in the first window 710is outputted to the first earphones 750, and set an audio output pathwherein an audio signal corresponding to the second applicationdisplayed in the second window 720 is outputted to the second earphones760, and set an audio output path wherein an audio signal (e.g., a thirdaudio signal) corresponding to a third application displayed in a thirdwindow is outputted to the third earphones 770.

In response to a plurality of earphones being connected, the processor120 of various embodiments may set an audio output path corresponding toeach window based on information (e.g., default value) set to theelectronic device 101. Or, in response to the plurality of earphonesbeing connected, the processor 120 may set an audio output pathcorresponding to each window based on a user input. For example, inresponse to enabling to output the audio signal corresponding to thefirst application displayed in the first window 710 to the firstearphones 750 and the second earphones 760, and output the audio signalcorresponding to the second application displayed in the second window720 to the third earphones 770, the processor 120 may change to outputthe audio signal corresponding to the first application displayed in thefirst window 710 to the first earphones 750, and output the audio signalcorresponding to the second application displayed in the second window720 to the second earphones 760 and the third earphones 770, inaccordance with a user's selection. In FIG. 7, only wired earphones areillustrated, but the earphones may be wired earphones and wirelessearphones.

FIG. 8 is a diagram illustrating an example of controlling an audiovolume for each application according to various embodiments.

Referring to FIG. 8, a processor (e.g., the processor 120) of anelectronic device (e.g., the electronic device 101) may construct amulti-window divided into two ones in a horizontal direction, to providea first user interface 810 of displaying an execution screen of a firstapplication in a first window 811 arranged at a left side, anddisplaying an execution screen of a second application in a secondwindow 813 arranged at a right side. While the first user interface 810is displayed, the processor 120 may obtain a user input 815. The userinput 815 may be a drag from a bezel region of a top of the electronicdevice 101 of a horizontal direction toward a display region.

In response to the user input 815 being obtained, the processor 120 mayprovide a second user interface 820 including a control menu 821. Thecontrol menu 821 may include a first volume adjustment bar foradjustment of a volume of a first application, and a second volumeadjustment bar for adjustment of a volume of a second application. Theprocessor 120 may control each of the first volume adjustment bar andthe second volume adjustment bar according to a user input, to adjustthe volumes of the first application and the second application,respectively. For example, the processor 120 may decrease a volume levelof the first application based on a user input of touching the firstvolume adjustment bar, and increase a volume level of the secondapplication based on a user input of touching the second volumeadjustment bar. That is, the processor 120 may differently adjust thevolume of the first application and the volume of the secondapplication. Besides this, the control menu 821 may include even an itemfor controlling communication (e.g., Wi-Fi and Bluetooth) of theelectronic device 101, a display direction thereof, an illuminancethereof, a battery thereof, etc.

The processor 120 of various embodiments may identically adjust thevolume levels of the first application and the second application basedon a user input of touching the first volume adjustment bar or thesecond volume adjustment bar as well. For example, the initiallyprovided volume levels of the first volume adjustment bar and the secondvolume adjustment bar may be identical as well and may be different aswell. In response to the initially provided volume levels of the firstvolume adjustment bar and the second volume adjustment bar beingdifferent, the processor 120 may identically apply the volume level thatis adjusted based on the user input of touching the first volumeadjustment bar or the second volume adjustment bar.

The processor 120 may provide a third user interface 850 of displayingthe execution screen of the first application in the first window 811arranged at a left side, and displaying the execution screen of thesecond application in the second window 813 arranged at a right side.The third user interface 850 may be identical with the first userinterface 810. While the third user interface 850 is displayed, theprocessor 120 may obtain a user input 851. The user input 851 may be atouch input of touching the execution screen of the second applicationdisplayed in the second window. The touch input may be a tap input ofonce pressing a display device (e.g., the display device 160) of theelectronic device 101 or be a long press input of long pressing thedisplay device 160.

In response to the user input 851 being obtained, the processor 120 mayprovide a fourth user interface 860 including a control menu 861. Thecontrol menu 861 may include a second volume adjustment bar foradjustment of a volume of the second application. The processor 120 mayadjust (e.g., increase or decrease) a volume level of the secondapplication based on a user input of touching the second volumeadjustment bar. Though not illustrated, the control menu 861 may furtherinclude an item (e.g., play, pause, fast forward, reverse forward, timeadjustment bar) for controlling the playing of the second application.Or, in response to a user input being obtained on the execution screenof the first application, the processor 120 may display a first volumeadjustment bar for adjustment of the volume of the first application.

A user input (e.g., the user input 815 and the user input 851) ofvarious embodiments may include various kinds of inputs which arepreviously set to the electronic device 101 so as to adjust a volume atthe time of multi-window execution. The processor 120 of variousembodiments may differentiate a volume level of an application based oninformation of the application. For example, the processor 120 may set avolume level of a phone application, greater than a volume level of avideo application. Or, the processor 120 may differently set priorityorder (or weight value) by application, and differentiate a volume levelof an application according to the set priority order. For example, theprocessor 120 may set the volume level of the phone application to themaximum, and set a volume level small in order of a video application, amusic application, and a game application. Here, the volume level of theapplication may mean a level which is initially set after theapplication is executed. Thereafter, the volume level of the applicationmay be adjusted according to a user's selection, and the adjusted volumelevel may be stored in a memory (e.g., the memory 130), and be appliedin response to the application being executed in the future.

FIG. 9 is a flowchart illustrating a method for changing an audio outputpath based on a window position in an electronic device according tovarious embodiments.

Referring to FIG. 9, in operation 901, a processor (e.g., the processor120) of an electronic device (e.g., the electronic device 101) maydisplay a plurality of applications through a multi-window. As in FIG. 5or FIG. 8, the processor 120 may display an execution screen of a firstapplication in a first window, and display an execution screen of asecond application in a second window.

In operation 903, the processor 120 of the electronic device 101 maycontrol audio output correspondingly to each window. For example, theprocessor 120 may control to process an audio signal corresponding tothe first application displayed in the first window, to output to aright terminal of earphones, and control to process an audio signalcorresponding to the second application displayed in the second window,to output to a left terminal of the earphones. In response to the audiosignal corresponding to the first application being a stereo scheme, theprocessor 120 may control to unite left/right audio signalscorresponding to the first application into one, to output to the rightterminal of the earphones. Or, in response to the audio signalcorresponding to the first application being a mono scheme, theprocessor 120 may control to output to the right terminal of theearphones without separately processing (e.g., uniting into one) of theaudio signal.

The processor 120 controls display and output through the multi-window.In FIG. 9, it is illustrated that operation 901 is first performed andoperation 903 is later performed, but operation 901 and operation 903may be performed simultaneously.

In operation 905, the processor 120 of the electronic device 101 maysense whether a window position is switched. The window position may beswitched based on a user input. For example, the processor 120 mayobtain a touch on the execution screen of the first application througha touch circuitry of the electronic device 101, and receive a user input(e.g., a drag and drop) of moving the obtained touch to the executionscreen of the second application. Or, the processor 120 may obtain thatthe obtained touch on the execution screen of the first application ismaintained (e.g., long press) during a predetermined time, and receive auser input of flicking the obtained touch toward the execution screen ofthe second application. Or, the processor 120 may receive a user inputin which an inclination of a predetermined angle or more of theelectronic device 101 is obtained in a direction of displaying theexecution screen of the second application. The user input for thewindow position switching may be previously set to the electronic device101 as well, and may be set by a user as well.

Or, the processor 120 may obtain a touch on the execution screen of thesecond application, and receive a user input of moving the obtainedtouch to the execution screen of the first application, and obtain thatthe obtained touch on the execution screen of the second application ismaintained (e.g., long press) during a predetermined time, and mayreceive a user input of flicking the obtained touch toward the executionscreen of the first application or a user input in which an inclinationof a predetermined angle or more of the electronic device 101 isobtained in a direction of displaying the execution screen of the firstapplication.

In operation 907, the processor 120 of the electronic device 101 maycontrol the displaying of the execution screen of the application basedon the switched window position. That is, in response to a user inputfor switching the window position being obtained in course of displayingthe execution screen of the first application in the first window anddisplaying the execution screen of the second application in the secondwindow, the processor 120 may display the execution screen of the secondapplication in the first window, and display the execution screen of thefirst application in the second window.

In operation 909, the processor 120 of the electronic device 101 maychange an audio output path based on the switched window position. Theprocessor 120 may control to output an audio signal of an applicationdisplayed in each window, to an audio output path corresponding to eachwindow. For example, while an audio signal corresponding to the firstapplication displayed in the first window is outputted to a rightterminal of earphones, and an audio signal corresponding to the secondapplication displayed in the second window is outputted to a leftterminal of the earphones, in response to a user input for switching thewindow position being obtained, the processor 120 may output the audiosignal corresponding to the second application displayed in the firstwindow, to the right terminal of the earphones, and output the audiosignal corresponding to the first application displayed in the secondwindow, to the left terminal of the earphones.

In FIG. 9, it is illustrated that operation 907 is first performed andoperation 909 is later performed, but operation 907 and operation 909may be performed simultaneously.

FIG. 10 is a diagram illustrating an example of changing an audio outputpath in accordance with a window position change according to variousembodiments.

Referring to FIG. 10, while earphones are connecting to a connectionterminal (e.g., the connection terminal 178) of the electronic device101, a processor (e.g., the processor 120) of an electronic device(e.g., the electronic device 101) may provide a first user interface1010 of constructing a multi-window divided into two ones in ahorizontal direction. The first user interface 1010 may display anexecution screen of a first application in a first window 1011 arrangedat a left side, and display an execution screen of a second applicationin a second window 1013 arranged at a right side. The processor 120 mayset an audio output path wherein a first audio signal corresponding tothe first application is outputted to a right terminal 1017 ofearphones, and a second audio signal corresponding to the secondapplication is outputted to a left terminal 1015 of the earphones.

The processor 120 may receive a user input on a second user interface1020. The second user interface 1020 may be identical with the firstuser interface 1010. The user input may be an input in which a touch1021 is obtained on the execution screen of the first application, andthe obtained touch 1021 is dragged (1023) to the execution screen of thesecond application and is released (e.g., dropped).

In response to the user input being obtained, the processor 120 mayprovide a third user interface 1030 converting an execution screen of anapplication within a window. The third user interface 1030 may displaythe execution screen of the second application in a first window 1031arranged at a left side, and display the execution screen of the firstapplication in a second window 1033 arranged at a right side. In thiscase, the processor 120 may set an audio output path wherein a secondaudio signal corresponding to the second application displayed in thefirst window 1031 is outputted to a right terminal 1037 of earphones,and a first audio signal corresponding to the first applicationdisplayed in the second window 1033 is outputted to a left terminal 1035of the earphones.

FIG. 11 is a flowchart illustrating a method of controlling audio outputin accordance with a phone event in an electronic device according tovarious embodiments.

Referring to FIG. 11, in operation 1101, a processor (e.g., theprocessor 120) of an electronic device (e.g., the electronic device 101)may display an execution screen of a first application. The firstapplication may output an audio as well, and may not output the audio aswell. The first application may be an application different from anapplication associated with a phone. The application associated with thephone may include at least one of phone (e.g., voice call or video call)related functions included in a phone application, a video callapplication (e.g., face time), a Voice over Internet protocol (VoIP)application, and a messenger application.

In operation 1103, the processor 120 of the electronic device 101 mayobtain a phone event. The phone event may be an event in which a call isreceived to the electronic device 101. Or, the phone event may be anevent of requesting the execution of the application associated with thephone from a user. In response to receiving a request for the executionof the application associated with the phone in course of the executionof the first application, the processor 120 may construct amulti-window. Or, the processor 120 may construct the multi-window aswell and may not construct the multi-window as well according to settingof the electronic device 101 or a user's selection. Also, the processor120 may construct and display any one of the execution screen of thefirst application or a screen of the phone event in the form of a pop-upwindow according to setting of the electronic device 101 or a user'sselection.

In response to the phone event being obtained in course of the executionof the first application, the processor 120 of various embodiments maydistinguish whether earphones have been connected to a connectionterminal (e.g., the connection terminal 178) of the electronic device101. In response to the earphones being connected, the processor 120 mayconstruct the multi-window. In response to the earphones not beingconnected, the processor 120 may not construct the multi-window. Inresponse to not constructing the multi-window, the processor 120 maydisplay the execution screen of the application associated with thephone, instead of the execution screen of the first application. Thatis, the processor 120 may process the first application as a background,and process the application associated with the phone as a foreground,to display on a display device (e.g., the display device 160) of theelectronic device 101.

In response to the phone event being obtained during the execution ofthe first application, the processor 120 of various embodiments maydistinguish whether the first application is an application in whichaudio output is possible, or is currently outputting an audio signal. Inresponse to the first application being the application in which audiooutput is possible (or in response to being currently outputting theaudio signal), the processor 120 may construct the multi-window. Inresponse to the first application not being the audio outputapplication, the processor 120 may not construct the multi-window.

In response to the phone event being obtained during the execution ofthe first application, the processor 120 of various embodiments mayconstruct the multi-window based on information of the first applicationand the connection or non-connection of earphones. For example, inresponse to the first application being the audio output application,and the earphones being connected to the connection terminal 178, theprocessor 120 may construct the multi-window. In response to the firstapplication being the audio output application, and the earphones notbeing connected to the connection terminal 178, the processor 120 maynot construct the multi-window.

Or, in response to the first application being the audio outputapplication, and the earphones not being connected to the connectionterminal 178, the processor 120 may construct the multi-window, andcontrol not to output an audio signal of the first application. Inresponse to the first application not being the audio outputapplication, and the earphones being connected to the connectionterminal 178, the processor 120 may construct the multi-window. Inresponse to the first application not being the audio outputapplication, and the earphones not being connected to the connectionterminal 178, the processor 120 may construct the multi-window or maynot construct the multi-window. This is merely an issue ofimplementation, and the present disclosure is not limited by thedescription.

In operation 1105, the processor 120 of the electronic device 101 mayidentify a display direction of the electronic device 101. The displaydirection is a direction in which the electronic device 101 is put, andmay be, for example, a vertical direction (or a vertical mode) or ahorizontal direction (or a horizontal mode).

In operation 1107, the processor 120 of the electronic device 101 mayconstruct the multi-window based on the display direction of theelectronic device 101. In response to the display direction of theelectronic device 101 being the vertical direction, the processor 120may construct the multi-window wherein each window is divided up (e.g.,first window) and down (e.g., second window). Also, in response to thedisplay direction of the electronic device 101 being the horizontaldirection, the processor 120 may construct the multi-window wherein eachwindow is divided left (e.g., first window) and right (e.g., secondwindow).

At the time of multi-window construction, the processor 120 mayconstruct an execution screen of an application within a window based onat least one of a display direction of a multi-window, a display size orinformation (e.g., an attribute, a type, etc.) of the application. Forexample, the processor 120 may adjust a size of a letter included in thefirst application, or adjust an amount of information included in thefirst application. In response to the first application not being ableto be displayed in the vertical direction (e.g., a game application anda video application), the processor 120 may display the execution screenof the first application in the horizontal direction, and display, as anon-used region, an up/down partial region of the window displayed inthe horizontal direction as well.

In operation 1109, the processor 120 of the electronic device 101 mayset an audio output path based on the window position. For example, theprocessor 120 may display the execution screen of the first applicationin the first window, and display the execution screen of the applicationassociated with the phone in the second window. In this case, theprocessor 120 may set an audio output path wherein an audio signal ofthe first application displayed in the first window is outputted to aright terminal of earphones, and set an audio output path wherein anaudio signal of the application associated with the phone displayed inthe second window is outputted to a left terminal of the earphones.Also, it is vice versa.

In operation 1111, the processor 120 of the electronic device 101 mayoutput an audio corresponding to each application via the set audiooutput path. The processor 120 may output the audio signal of the firstapplication displayed in the first window, to the right terminal of theearphones, and output the audio signal of the application associatedwith the phone displayed in the second window, to the left terminal ofthe earphones.

FIG. 12 is a diagram illustrating an example of controlling audio outputin accordance with a phone event according to various embodiments.

Referring to FIG. 12, a processor (e.g., the processor 120) of anelectronic device (e.g., the electronic device 101) may provide a userinterface 1210 including an execution screen of a first application. Atthe time of user interface 1210 provision, earphones (e.g., a leftterminal 1250 of the earphones and a right terminal 1260 of theearphones) may be connected to a connection terminal (e.g., theconnection terminal 178) of the electronic device 101. In response to aphone event being obtained while the user interface 1210 is displayed,the processor 120 may construct a multi-window, to provide a second userinterface 1220. The processor 120 may set a first window 1221 to anupper side of a vertical direction, and set a second window 1223 to alower side of the vertical direction, based on a display direction ofthe electronic device 101. The processor 120 may display the executionscreen of the first application in the first window 1221, and display anexecution screen of an application associated with a phone in the secondwindow 1223. The processor 120 may output an audio signal of the firstapplication displayed in the first window 1221, to the right terminal1260 of the earphones, and output an audio signal of the applicationassociated with the phone displayed in the second window 1223, to theleft terminal 1250 of the earphones.

The processor 120 of various embodiments may identify an applicationthat will be displayed in the first window 1221 based on information ofthe application or setting information of the electronic device 101. Thesetting information may be set to display a firstly executed application(e.g., the first application) in the first window 1221, and display alater executed application (e.g., the application associated with thephone) in the second window 1223. Or, it is vice versa. The processor120 may identify the application that will be displayed in the firstwindow 1221 based on priority order of the application. For example, inresponse to the application associated with the phone having higherpriority order than the first application, the processor 120 mayidentify to display the application associated with the phone in thefirst window 1221, and display the first application in the secondwindow 1223. Or, it is vice versa.

The processor 120 of various embodiments may construct a size of amulti-window differently based on information of an application orsetting information of the electronic device 101. For example, inresponse to the application associated with the phone having higherpriority order than the first application, the processor 120 mayconstruct a size of the second window 1223 that will display theapplication associated with the phone, greater than a size of the firstwindow 1221. That is, the processor 120 may display the execution screenof the application associated with the phone, greater than the executionscreen of the first application. Or, it is vice versa.

FIG. 13 is a flowchart illustrating a method of controlling audio outputin accordance with a video call event in an electronic device accordingto various embodiments.

Referring to FIG. 13, in operation 1301, a processor (e.g., theprocessor 120) of an electronic device (e.g., the electronic device 101)may display an execution screen of a first application. The firstapplication may output an audio as well, and may not output the audio aswell. The first application may be an application which is differentfrom an application associated with a video call. The applicationassociated with the video call (hereinafter, referred to as a ‘videocall application’) may include at least one of video call functionsincluded in a video call application (e.g., face time), a voice overInternet protocol (VoIP) application, and a messenger application.

In operation 1303, the processor 120 of the electronic device 101 mayobtain a video call event. The video call event may be an event ofdisplaying a video received from a counterpart electronic device in adisplay device (e.g., the display device 160) of the electronic device101 while making a call with a counterpart. In response to the videocall event being obtained during the execution of the first application,the processor 120 may construct a multi-window. Or, the processor 120may construct the multi-window as well and may not construct themulti-window as well according to setting of the electronic device 101or a user's selection.

In operation 1305, the processor 120 of the electronic device 101 maydistinguish a video call display scheme. The processor 120 may constructan execution screen of the video call application in the video calldisplay scheme in order to provide the execution screen of the videocall application through a multi-window. The video call display schememay include an overlay scheme and a resizing scheme. The overlay schememay be a scheme of overlaying and displaying the execution screen of thefirst application on a partial region of a call image. The resizingscheme may be a scheme of adjusting the execution screen of the videocall application, to display concurrently with the execution screen ofthe first application. The video call display scheme may be previouslyset to the electronic device 101, or be set by a user.

In the overlay scheme, in operation 1311, the processor 120 of theelectronic device 101 may identify a partial region of a call image as adisplay region. The execution screen of the video call application mayinclude a call image and a call control menu. The call image may includea video (e.g., a counterpart image) received from a counterpartelectronic device, and a video (e.g., my image) obtained from a camera(e.g., the camera module 180) of the electronic device 101. The callcontrol menu includes a function item related with the call, and mayinclude, for example, a call end button, a volume adjustment button, akeypad button, etc. In the execution screen of the video callapplication, the call control menu may be displayed on the call image.

To provide the execution screen of the video call application throughthe multi-window, the processor 120 may identify a partial region of thecall image as a display region. For example, the call image may includeall of a counterpart image and my image, and may be displayed centeringon the counterpart image at the time of multi-window construction. Inthis case, the processor 120 may identify, as the display region, aregion including only the counterpart image among the call image. Theprocessor 120 may identify the partial region of the call image as thedisplay region, based on a size of a window in which the executionscreen of the video call application is arranged.

In operation 1313, the processor 120 of the electronic device 101 mayarrange the call control menu on the call image. The processor 120 mayoverlay and arrange the call control menu on the call image which isidentified as the display region. At this time, the processor 120 mayconstruct the call control menu based on the size of the window in whichthe execution screen of the video call application is arranged. Forexample, in response to the size of the window being small, theprocessor 120 may delete some items among the call control menu, ordecrease a size of the call control menu.

In operation 1315, the processor 120 of the electronic device 101 mayarrange the execution screen of the first application in another partialregion of the call image. The processor 120 may arrange the executionscreen of the first application in the another partial region except thepartial region of the call image identified in operation 1311. Forexample, in response to the call image being divided into a first regionand a second region, and the first region being identified as thedisplay region, the second region may be identified as a region in whichthe execution screen of the first application is arranged. Here, thefirst region (e.g., the partial region of the call image) may correspondto the first window, and the second region (e.g., the another partialregion of the call image) may correspond to the second window. Or, thefirst region may correspond to the second window, and the second region(e.g., the another partial region of the call image) may correspond tothe first window.

For this, the processor 120 may construct a first layer and a secondlayer, and may overlay and arrange the second layer in a partial regionof the first layer. The first layer may include the execution screen ofthe video call application, and the second layer may include theexecution screen of the first application. The processor 120 may displaythe partial region of the call image in a region actually seen to a useramong the first layer and display the call control menu on the partialregion of the call image.

In the resizing scheme, in operation 1321, the processor 120 of theelectronic device 101 may resize the execution screen of the video callapplication. For example, the processor 120 may adjust the call imageand the call control menu included in the execution screen of the videocall application, adaptive to a window size. The processor 120 mayreduce the whole size of the execution screen of the video callapplication based on a window size that will display the executionscreen of the video call application. Or, the processor 120 may reduce asize of the call image or a size of the call control menu at a differentrate based on the window size. Or, the processor 120 may construct thecall control menu based on the adjusted size of the call image.

In operation 1323, the processor 120 of the electronic device 101 mayset a window position. In response to the multi-window being constructedin a horizontal direction, the processor 120 may set the video callapplication to a first window positioned at a left side, and set thefirst application to a second window positioned at a right side. Or, theprocessor 120 may set to display an execution screen of the firstapplication in the first window positioned at the left side, and displayan execution screen of the video call application in the second windowpositioned at the right side.

The processor 120 of various embodiments may set the window positionbased on information of the application or setting information of theelectronic device 101. Based on the setting information, the processor120 may set the firstly executed first application to the first window,and set the later executed video call application to the second window.Or, the processor 120 may set the video call application to the firstwindow and set the first application to the second window, based onpriority order of the application.

In operation 1331, the processor 120 of the electronic device 101 mayset an audio output path based on the window position. In response tothe multi-window being constructed in the horizontal direction, theprocessor 120 may set an audio output path corresponding to the videocall application displayed at a left side (e.g., first window), to aright terminal of earphones, and set an audio output path correspondingto the first application displayed at a right side (e.g., secondwindow), to a left terminal of the earphones. Or, the processor 120 mayset the audio output path corresponding to the first applicationdisplayed at the left side (e.g., first window), to the right terminalof the earphones, and set the audio output path corresponding to thevideo call application displayed at the right side (e.g., secondwindow), to the left terminal of the earphones.

In operation 1333, the processor 120 of the electronic device 101 mayoutput an audio corresponding to each application via the set audiooutput path. For example, the processor 120 may control to output anaudio signal corresponding to the video call application displayed inthe first window, to the right terminal of the earphones via the firstaudio output path. The processor 120 may control to output an audiosignal corresponding to the first application displayed in the secondwindow, to the left terminal of the earphones via the second audiooutput path.

In operation 1335, the processor 120 of the electronic device 101 maytrack the window position, to control the audio output path. Theprocessor 120 may change the execution screen of the application and theaudio output path based on the window position which is switchedaccording to whether a user input for the window position switching isobtained. The processor 120 of various embodiments may recognize atalker by using the camera module 180 of the electronic device 101, anddistinguish whether a position of a user who makes a video call ischanged based on the talker recognition, to change the window positionaccording to a user position change.

FIG. 14 is a diagram illustrating an example of constructing amulti-window based on a video call application in an electronic deviceaccording to various embodiments.

Referring to FIG. 14, a processor (e.g., the processor 120) of anelectronic device (e.g., the electronic device 101) may provide a firstuser interface 1410 including an execution screen of a firstapplication. The first application may be an application different froma video call application. The processor 120 may provide a second userinterface 1420 including an execution screen of the video callapplication. The second user interface 1420 may include a call imageincluding a counterpart image 1421 received from a counterpartelectronic device and my image 1423 obtained from a camera (e.g., thecamera module 180) of the electronic device 101, and a call control menu1425. The call control menu 1425 may be overlaid and displayed on thecall image.

At the time of displaying the execution screens of the first applicationand the video call application through the multi-window, the processor120 may provide a third user interface 1430 or a fourth user interface1440. The third user interface 1430 may construct the multi-window in anoverlay scheme. For example, the third user interface 1430 may display acall control menu 1435 on a partial region 1431 of the call image of thevideo call application, and overlay and display the execution screen ofthe first application in another partial region 1433 of the call image.The partial region 1431 may be a region which includes only thecounterpart image 1421 among the call image which includes thecounterpart image 1421 and my image 1423. The processor 120 may adjust asize of the call control menu 1435 based on a size of the partial region1431.

The fourth user interface 1440 may construct the multi-window in aresizing scheme. For example, the fourth user interface 1440 maydecrease and display the whole size of the execution screen of the videocall application based on a size of a first window 1441, and display theexecution screen of the first application in a second window. That is,the fourth user interface 1440 may adjust a call image and a callcontrol menu 1443 small at the same rate. Or, the processor 120 mayreduce a size of the call image or a size of the call control menu 1443at a different rate based on the size of the first window 1441. Or, theprocessor 120 may construct the call control menu 1443 based on theadjusted size of the call image.

In FIG. 14, the earphones are not illustrated, but it may be in a statein which one or more earphones are connected to a connection terminal(e.g., the connection terminal 178) of the electronic device 101.

FIG. 15 is a diagram illustrating an example of controlling a userinterface associated with a video call application in accordance with awindow position change in an electronic device according to variousembodiments.

Referring to FIG. 15, a processor (e.g., the processor 120) of anelectronic device (e.g., the electronic device 101) may provide a firstuser interface 1510 constructing a multi-window divided into two ones ina horizontal direction. The first user interface 1510 may display a callcontrol menu 1515 in a partial region 1511 of a call image of a videocall application, and overlay and display an execution screen of a firstapplication in another partial region 1513 of the call image. Theprocessor 120 may set an audio output path to output an audio signalcorresponding to the video call application displayed at a left side, toa right terminal of earphones, and output an audio signal correspondingto the first application displayed at a right side, to a left terminalof the earphones.

The processor 120 may receive a user input on a second user interface1520. The second user interface 1520 may be identical with the firstuser interface 1510. The user input may be an input in which a touch1521 is obtained on the execution screen of the video call application,and the obtained touch 1521 is dragged (1523) to the execution screen ofthe first application and is released (e.g., dropped).

In response to the user input being obtained, the processor 120 mayprovide a third user interface 1530 or a fourth user interface 1540converting an execution screen of an application within a window. Thethird user interface 1530 may display the execution screen of the firstapplication on a partial region 1531 of a call image of the video callapplication, and display a call control menu 1535 on another partialregion 1533 of the call image. The partial region 1531 of the call imagemay be a region (e.g., the partial region 1511 and a counterpart image)which has been displayed at the time of providing the first userinterface 1510 or the second user interface 1520. Another partial region1533 of the call image may be a region (e.g., the another partial region1513, part of the counterpart image, and my image) which has not beendisplayed at the time of providing the first user interface 1510 or thesecond user interface 1520. That is, in the first user interface 1510 orthe second user interface 1520, the another partial region 1533 of thecall image may be hidden by the execution screen of the firstapplication.

The fourth user interface 1540 may display the execution screen of thefirst application on another partial region 1541 of a call image of avideo call application, and display a call control menu in a partialregion 1543 of the call image. The another partial region 1541 of thecall image may be identical with the region (e.g., the another partialregion 1513, part of the counterpart image, and my image) which has notbeen displayed in the first user interface 1510 or the second userinterface 1520. The partial region 1543 of the call image may be theregion (e.g., the partial region 1511 and the counterpart image) whichhas been displayed in the first user interface 1510 or the second userinterface 1520.

At the time of providing the third user interface 1530 or the fourthuser interface 1540, the processor 120 may set an audio output pathwherein the audio signal corresponding to the first applicationdisplayed at the left side is outputted to the right terminal of theearphones, and the audio signal corresponding to the video callapplication displayed at the right side is outputted to the leftterminal of the earphones.

An operation method of an electronic device of various embodiments mayinclude displaying execution screens associated with a first applicationand a second application through a multi-window, respectively, andoutputting an audio signal corresponding to the first application and anaudio signal corresponding to the second application, to a left terminalof the earphones or a right terminal thereof, separately based on awindow position corresponding to each execution screen.

The outputting may include identifying the window position correspondingto the execution screen, identifying an audio output path based on theidentified window position, and outputting the audio signalcorresponding to each application via the identified audio output path.

The outputting may include outputting the audio signal corresponding tothe first application displayed in a first window, to the right terminalof the earphones, and outputting the audio signal corresponding to thesecond application displayed in a second window, to the left terminal ofthe earphones.

The method may further include sensing window position switching, tochange a window displaying an execution screen of each application, andchange an audio output path based on a switched window position.

A computer-readable recording medium of various embodiments may includea program of executing displaying execution screens associated with afirst application and a second application through a multi-window,respectively, and outputting an audio signal corresponding to the firstapplication and an audio signal corresponding to the second application,to a left terminal of the earphones or a right terminal thereof,separately based on a window position corresponding to each executionscreen.

The electronic device according to various embodiments may be one ofvarious types of electronic devices. The electronic devices may include,for example, a portable communication device (e.g., a smart phone), acomputer device, a portable multimedia device, a portable medicaldevice, a camera, a wearable device, or a home appliance. According toan embodiment of the disclosure, the electronic devices are not limitedto those described above.

According to various embodiments, it is to be understood that a singularform of a noun corresponding to an item may include one or more of thethings, unless the relevant context clearly indicates otherwise. As usedherein, each of such phrases as “A or B,” “at least one of A and B,” “atleast one of A or B,” “A, B, or C,” “at least one of A, B, and C,” and“at least one of A, B, or C,” may include all possible combinations ofthe items enumerated together in a corresponding one of the phrases. Asused herein, such terms as “1st” and “2nd,” or “first” and “second” maybe used to simply distinguish a corresponding component from another,and does not limit the components in other aspect (e.g., importance ororder). It is to be understood that if an element (e.g., a firstelement) is referred to, with or without the term “operatively” or“communicatively”, as “coupled with,” “coupled to,” “connected with,” or“connected to” another element (e.g., a second element), it means thatthe element may be coupled with the other element directly (e.g.,wired), wirelessly, or via a third element.

As used herein, the term “module” may include a unit implemented inhardware, software, or firmware, and may interchangeably be used withother terms, for example, “logic,” “logic block,” “part,” or“circuitry”. A module may be a single integral component, or a minimumunit or part thereof, adapted to perform one or more functions. Forexample, according to an embodiment, the module may be implemented in aform of an application-specific integrated circuit (ASIC).

Various embodiments as set forth herein may be implemented as software(e.g., the program 140) including one or more instructions that arestored in a storage medium (e.g., internal memory 136 or external memory138) that is readable by a machine (e.g., the electronic device 101).For example, a processor (e.g., the processor 120) of the machine (e.g.,the electronic device 101) may invoke at least one of the one or moreinstructions stored in the storage medium, and execute it, with orwithout using one or more other components under the control of theprocessor. This allows the machine to be operated to perform at leastone function according to the at least one instruction invoked. The oneor more instructions may include a code generated by a complier or acode executable by an interpreter. The machine-readable storage mediummay be provided in the form of a non-transitory storage medium. Wherein,the term “non-transitory” simply means that the storage medium is atangible device, and does not include a signal (e.g., an electromagneticwave), but this term does not differentiate between where data issemi-permanently stored in the storage medium and where the data istemporarily stored in the storage medium.

According to an embodiment, a method according to various embodiments ofthe disclosure may be included and provided in a computer programproduct. The computer program product may be traded as a product betweena seller and a buyer. The computer program product may be distributed inthe form of a machine-readable storage medium (e.g., compact disc readonly memory (CD-ROM)), or be distributed (e.g., downloaded or uploaded)online via an application store (e.g., PLAYSTORE), or between two userdevices (e.g., smart phones) directly. If distributed online, at leastpart of the computer program product may be temporarily generated or atleast temporarily stored in the machine-readable storage medium, such asmemory of the manufacturer's server, a server of the application store,or a relay server.

According to various embodiments, each component (e.g., a module or aprogram) of the above-described components may include a single entityor multiple entities. According to various embodiments, one or more ofthe above-described components may be omitted, or one or more othercomponents may be added. Alternatively or additionally, a plurality ofcomponents (e.g., modules or programs) may be integrated into a singlecomponent. In such a case, according to various embodiments, theintegrated component may still perform one or more functions of each ofthe plurality of components in the same or similar manner as they areperformed by a corresponding one of the plurality of components beforethe integration. According to various embodiments, operations performedby the module, the program, or another component may be carried outsequentially, in parallel, repeatedly, or heuristically, or one or moreof the operations may be executed in a different order or omitted, orone or more other operations may be added.

What is claimed is:
 1. An electronic device comprising: an audio module;a display; a connection terminal connected to earphones; a communicationinterface; and a processor electrically connected to the audio module,the display, the connection terminal, or the communication interface,wherein the processor is configured to: display, via a multi-window ofthe display, respectively execution screens associated with a firstapplication and a second application, the execution screens including afirst screen corresponding to the first application and a second screencorresponding to the second application, the first screen beingdisplayed in a first window of the multi-window, the second screen beingdisplayed in a second window of the multi-window, a display area of thedisplay being divided into the first window and the second window,detect that the earphones are connected to the connection terminal,identify a number of the multi-window and a number of the connectedearphones, based on the number of the multi-window and the number of theconnected earphones, determine an earphone and terminal of thedetermined earphone to output an audio signal corresponding to eachwindow of the multi-window, output the audio signal corresponding to theeach window of the multi-window through the determined earphone and thedetermined terminal of the determined earphone, detect an input fordisplaying a control menu, the input comprising a drag input for movingfrom a bezel region of the display to the display area of the display,in response to the detecting the input, display, via the display, thecontrol menu including a first volume bar for adjustment of a volume ofthe first application and a second volume bar for adjustment of a volumeof the second application, wherein the first volume bar and the secondvolume bar are simultaneously displayed on the first screen and thesecond screen, respectively, receive a user input for switching thefirst window and the second window, the user input comprising a touchinput for touching the first screen and a drag input for moving thetouch input from the first screen to the second screen, in response tothe receiving the user input, display the first screen through thesecond window, and the second screen through the first window, and basedon a position of switched window, output the audio signal correspondingto the each window of the multi-window.
 2. The electronic device ofclaim 1, wherein the processor is configured to identify the windowposition corresponding to the execution screen, and identify an audiooutput path based on the identified window position, and output theaudio signal corresponding to each application via the identified audiooutput path.
 3. The electronic device of claim 1, wherein the processoris configured to set an audio output path corresponding to each windowin consideration of at least one of a display direction of theelectronic device, a number of multi-window or the number of theearphones.
 4. The electronic device of claim 1, the first window isarranged at a left side of a horizontal direction, or is arranged at anupper side of a vertical direction, and the second window is arranged ata right side of the horizontal direction, or is arranged at a lower sideof the vertical direction.
 5. The electronic device of claim 1, whereinthe processor is configured to adjust a volume level of the firstapplication and a volume level of the second application differentlybased on an obtained user input.
 6. An electronic device comprising: anaudio module; a display; a connection terminal connected to earphones; acommunication interface; and a processor electrically connected to theaudio module, the display, the connection terminal, or the communicationinterface, wherein the processor is configured to: display an executionscreen of a first application, construct a multi-window in response to aphone event being obtained, display, via the multi-window of thedisplay, respectively execution screens of the first application and anapplication associated with a phone, the execution screens including afirst screen corresponding to the first application and a second screencorresponding to the application associated with the phone, the firstscreen being displayed in a first window of the multi-window, the secondscreen being displayed in a second window of the multi-window, a displayarea of the display being divided into the first window and the secondwindow, detect that the earphones are connected to the connectionterminal, identify a number of the multi-window and a number of theconnected earphones, based on the number of the multi-window and thenumber of the connected earphones, determine an earphone and terminal ofthe determined earphone to output an audio signal corresponding to eachwindow of the multi-window, output the audio signal corresponding to theeach window of the multi-window through the determined earphone and thedetermined terminal of the determined earphone, detect an input fordisplaying a control menu, the input comprising a drag input for movingfrom a bezel region of the display to the display area of the display,in response to the detecting the input, display, via the display, thecontrol menu including a first volume bar for adjustment of a volume ofthe first application and a second volume bar for adjustment of a volumeof the second application, wherein the first volume bar and the secondvolume bar are simultaneously displayed on the first screen and thesecond screen, respectfully, receive a user input for switching thefirst window and the second window, the user input comprising a touchinput for touching the first screen and a drag input for moving thetouch input from the first screen to the second screen, in response tothe receiving the user input, display the first screen through thesecond window, and the second screen through the first window, and basedon a position of switched window, output the audio signal correspondingto the each window of the multi-window.
 7. The electronic device ofclaim 6, wherein the processor is configured to identify a displaydirection of the multi-window as one of a horizontal direction or avertical direction based on the display direction of the electronicdevice.
 8. The electronic device of claim 6, wherein the processor isconfigured to set a window that will display the execution screen of theapplication associated with the phone, based on information of theapplication or setting information of the electronic device.
 9. Theelectronic device of claim 6, wherein the processor is configured to, inresponse to a video call event being obtained while the execution screenof the first application is displayed, identify a video call displayscheme, and construct the multi-window based on the video call displayscheme.
 10. The electronic device of claim 9, wherein the processor isconfigured to: in response to the video call display scheme being anoverlay scheme, overlay and display the execution screen of the firstapplication in a partial region of a call image comprised in theapplication associated with the video call.
 11. The electronic device ofclaim 9, wherein the processor is configured to, in response to thevideo call display scheme being a resizing scheme, adjust the executionscreen of the application associated with the video call, to display thesame concurrently with the execution screen of the first application.12. The electronic device of claim 6, wherein the processor isconfigured to construct any one of the execution screen of the firstapplication or the execution screen of the application associated withthe phone, in a form of a pop-up window, according to setting of theelectronic device or a user's selection.
 13. The electronic device ofclaim 6, wherein the processor is configured to construct an executionscreen of an application within each window based on at least one of adisplay direction of the multi window, a display size of themulti-window or information of the application.
 14. The electronicdevice of claim 7, wherein the processor is configured to: in responseto obtaining a user input for window position switching, overlay anddisplay the execution screen of the first application in another partialregion of a call image, and display the partial region of the callimage.
 15. An operation method of an electronic device, the methodcomprising: displaying, via a multi-window of a display, respectivelyexecution screens associated with a first application and a secondapplication, the execution screens including a first screencorresponding to the first application and a second screen correspondingto the second application, the first screen being displayed in a firstwindow of the multi-window, the second screen being displayed in asecond window of the multi-window, a display area of the display beingdivided into the first window and the second window; detecting thatearphones are connected to a connection terminal of the electronicdevice; identifying a number of multi-window and a number of theconnected earphones; based on the number of the multi-window and thenumber of the connected earphones, determining an earphone and terminalof the determined earphone to output an audio signal corresponding toeach window of the multi-window, outputting the audio signalcorresponding to the each window of the multi-window through thedetermined earphone and the determined terminal of the determinedearphone; detecting an input for displaying a control menu, the inputcomprising a drag input for moving from a bezel region of the display tothe display area of the display; in response to the detecting the input,displaying, via the display, the control menu including a first volumebar for adjustment of a volume of the first application and a secondvolume bar for adjustment of a volume of the second application, whereinthe first volume bar and the second volume bar are simultaneouslydisplayed on the first screen and the second screen, respectfully;receiving a user input for switching the first window and the secondwindow, the user input comprising a touch input for touching the firstscreen and a drag input for moving the touch input from the first screento the second screen; in response to the receiving the user input,displaying the first screen through the second window, and the secondscreen through the first window; and based on a position of switchedwindow, outputting an audio signal corresponding to the each window ofthe multi-window.
 16. The method of claim 15, wherein the outputtingcomprises: identifying the window position corresponding to theexecution screen; identifying an audio output path based on theidentified window position; and outputting the audio signalcorresponding to each application via the identified audio output path.17. The method of claim 15, wherein the outputting comprises: outputtingthe audio signal corresponding to the first application displayed in thefirst window, to a right terminal of the earphones; and outputting theaudio signal corresponding to the second application displayed in thesecond window, to a left terminal of the earphones.